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Determining Accuracy of Cultural Perceptions of 
Oriental Cultures 

Cross cultural awareness and accuracy of cultural perceptions of 
public school students have concerned educators in the United States since 
the 1920's (Rivera, 1984). However, schools often fail to go beyond 
simply avoiding stereotypical presentations of ininority groups and attempt 
to promote harmonious inter-group attitudes (Pratt, 1972). Since 
instructional materials are important sources of cultural information, the 
first step in such an endeavor would be a precise description of the 
attitudes and values contained in these materials. The primary purpose 
of this paper is to discuss e technique. Evaluation Coefficient Analysis 
(ECA) which allows educators to determine accuracy of representation. 
The second goal of this paper is to present a study descnbing the use 
of ECA to indicate representation in classroom instructional materials. 

BACKGROUND 

Culture, according to Highwater, is the reason for the distance 
between nations (Highwater, 1978). In order to narrow the cultural gao 
between nations more accurate cultural perceptions must be developed so 
that understanding can be accomplished. Such understanding is especially 
important in nations such as the United States and other countries which 
are composed of states or nation states, where students may fail to think 
of themselves as a part of a global sphere. 

The focus of numerous previous studies has been ethnic material, 

textbooks, or children's literature. Such studies have enphasized the 
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accuracy of the material regarding certain cultural groups without offering 
a comparison between the material and the textbook (Stoddard, 1984; 
Chapman, 1981; Gast, 1967). Instead of providing a comprehensive review 
of one teaching tool, the current study attempted to provide a comparison 
of treatments of a single cultural grouo in social studies texts and 
suggested children's literature. An attempt was also made to discover if 
there is a need for supplemental materials in elementary social studies 
for the purpose of developing accurate cultural perceptions or if using 
only the textbook is sufficient. This is not to imply that the textbook 
is not an invaluable tool for transmitting knowledge, but that educators 
might find it beneficial to follow suggestions for additional readings. 

In the United States, the single material repeatedly used to 
transmit knowledge is the textbook (Anyon, 1978; Brandt, 1980). Textbooks 
have m?iy positive attributes and have made great strides in the area of 
cultural perspectives. Although this is true, some studies have shown 
that social studies texts often present biased views of ethnic or racial 
-group- (Michigan State Department of Education, 1972; Chapman, 1981). 
Another problem encountered in the use of the social studies texts as the 
single tool for transmitting knowledge is the fact that most textbooks 
tend to be informational in content and fail to emphasi2e the human 
dimension of historical events and cultures (Black, 1967; Chambers, 1971; 
Garcia and Logan, 1983). 

Stoddard proposed that children's literature is one method for 
Introducing "global concepts and multicultural understanding" (Stoddard, 
1984). Of the research studies which focus on the effect of children's 
literature on cultural attitudes of children, several have found a 
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positive effect (Fisher, 1965; Schwartz, 1973; Frankel, 1972). 
Through using books which contain accurate representation of specific 
culture and which are written at a level for children, accurate cultural 
perceptions of similarities as well as differences can be noted. Based 
on such studies. Chambers maintains that children's literature, when used 
along with the social studies texts, can help children to visualize and 
become a part of a culture "in a vicarious way" (Chambers, 1971). 

Finally, and importantly, the justification for this study is 
developed in part from the descriptions of criteria offered by the 
textbook publishers concerning the supplemental children's literature. 
The criteria, in some cases, support the findings of Skeel , Gast, Kane, 
and others; that is, that it is important that the children's literature 
used in social studies classrooms be accurate and at a level appropriate 
for the child (Skeel, 1979). Skeel reported that selection should be 
made with care so both similarities and differences between various 
cultures are shown (Skeel, 1979). Recognizing and evaluating the 
-usefulness of materials has been the focus of a number of studies. The 
main areas of exploration of these studies included the area of 
stereotypical charar*erization of ethnic groups, especially of those in 
the United States (Gast, 1967; Kane, 1970). The current study exolores 
the cultural perceptions reflected in the selected social studies texts 
and suggested supplemental children's literature about a group of people 
outside the United States which has played a major role in the development 
of the United States. 
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METHODS AND DATA SOURCE 



Many educators and researchers have gathered subjective data in the 
area of cultural perceptions. In turn they have indicated their belief 
that accurate cultural perceptions can be enhanced through the use of 
children's literature as a ijpplemental material. However, there have 
been few objective assessments made concerning the cultural information 
offered in the children's literature suggested by the social studies text 
publishers and the texts themselves. Furthermore, neither the quality of 
the cultural information contained in the material nor the relationship 
between the two types of materials has been previously investigated. 

The procedures and materials used in this study were designed to 
gain information concerning the amount o* cultural information contained 
in the selected social studies texts as well as the children's literature 
suggested by the text publishers. Major research questions in the study 
were: Do the selected social studies textbooks provide an unbiased 
.representation of Oriental cultures? Dogs the children's literature 
suggested for use by publishers of social studies textbooks provide a 
favorable representation of Oriental cultures? Materials analyzed were 
five social studies textbook series and twenty-six children's literature 
books listed as supplemental reading. 

There were two basic criteria used in selection of the social studies 
textbooks analy2ed in the study. The first cnterion was that the study 
would be limited to texts that were at the sixth grade level as this was 
the level proposed by the National Council for the Social Studies for 
Inclusion of study of cultures of the Eastern Hemisohere (Social Education, 
1984). 



The second criterion for textbook selection was the inclusion of 
children's literature as supplemental material. References for the use 
of chllrf-en's literature were included in either the content of the text 
or in separate bibliographical listings, usually in the teacher's edition. 

The criteria for the children's literature evaluated in the study 
was limited. For inclusion in the 5tudy. the literature had to be listed 
as supplemental readings in bibliographies of the selected textbooks or 
in the content of the text. 

The instrument used for analysis of the textbooks and children's 
literature in the study was ECA. The Evaluation Coefficient Analysis (ECA) 
is a relatively simple instrument which focuses on the value judgements 
expressed in written materials. It provides a quantitative neasure of the 
content contained in written materials, and is especially useful in 
relation to evaluation concerning cultural or minority groups (Pratt, 1972). 

The procedure for using ECA includes: (1) Defining materials to be 
analyzed in the study. (2) Defining subjects of interest. (3) Preparing 
ECA Score Sheets (Appendix A) and copies of the ECA Word List (Apoendix B) 
for each evaluator. (4) Scanning materials for references to the subjects 
of interest. (5) Listing evaluative terms. (6) Conparing terms to the 
ECA Word List. (7) Calculating the Coefficient of Evaluation (Pratt, 1972). 

Each social studies textbook was scanned for terms or references 
made concerning Oriental cultures. The books were scanned, page by page, 
in their entirety as references to the specific groups are not always 
listed in the table of contents. Terms and page numbers were listed on 
the ECA Score Sheet for further reading and evaluation. 
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After each book was scanned, the noted pages and terns were read 
carefully In order to evaluate the tenrc reUting to Oriental cultures as 
being either favorable or unfavorable. The final step in the analysis of 
the textbooks was to assign a rating and calculate the coefficient for 
each bock. 

The children's literature analyzec as a oart of the study followed 
similar steps as the textbook analysis. Each book was read in its entirety 
so that the researcher could become familiar with the intent of the author 
and the design or format of the book. 

Following the first reading, each book was scanned for terms which 
were specifically related to Oriental cultures. The terms and page 
nunbers were listed on the EGA Score Sheet for further reading and 
evaluation. 

The next step in the analysis of the children's literature was the 
second reading of each book with special attention being given to noted 
terms for rating purposes. After this step, each tenns was rated as 
being favorable or unfavorable in its usage related to Oriental cultures. 
The final step in analysis of the children's literature was to calculate 
the Evaluation Coefficient for each book. 

This was accomplished by using the fonnt'la developed by Pratt (1972). 
The formula used was : 

T+ X ICO 

« CCA 
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RESULTS 



Results of the study are presented in two general sections. 
Ratings provided by ECA are presented in the first section for cultural 
information in the selected social studies texts. The ratings of 
children's literature for cultural information is oresented in section 
two. Also in the second section, the percentage of terms used in the 
social studies texts and children's literature is presented. 

In the study selected elenientary social studies textbooks were 
evaluated for information which focused on Oriental cultures- To identify 
the amount of information concerning Oriental cultures in the textbooks, 
the procedures outlined in ECA were carefully followed. 

Of the five textbooks analyzed, three ratings were above the neutral 
range of 50-59. Two books rated within the neutral range of 50-59. Terms 
used to describe the culture were not limited, in the sense of being 
stereotypical. Examples of the favorable, unfavorable and neutral 
evaluative terms included pleasant (+), skilled (+), fear (-), and foreign 
(0). 

" INSERT TABLE ONE ABOUT HERE - 

The scores, or ratings of the selected social studies textbooks as 
determined by ECA, indicate a neutral to favorable representation of 
Oriental cultures. Furthermore, terms used in evaluations of Oriental 
culture did not reflect stereotypical bias. 

The children's literature suggested by the selected social studies 
textbook publishers was analyzed to determine, by using ECA, If a favorable 
representation of Oriental cultures is given. Because of the narrative 
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form of children's literature, synonyms of terms which are listed on 
the ECA Word List (Appendix B) were used in addition to the words on the 
list for a more accurate rating. (See Appendix C for bibliographical 
information on the children's literature.) 

Those books suggested by social stadies textbook publishers 
included thirteen with ratings above the neutral range of 50-59. Nine 
books received ratings within the neutral range, and four books received 
ratings below the neutral range. Cumulatively, of the twenty-six 
children's literature books suggested, the median rating was 60, indicating 
a favorable treatment of Oriental cultures. 

- INSERT TABLE TWO ABOUT HERE - 

In order to provide further clarification of the representat^--n of 
Oriental cultures in the selected sixth grade social studies texts and the 
suggested children's literature, percentage of responses was corDared by 
category (favorable, unfavorable, neutral). The tenns used to describe 
■Oriental cultures in both selected social studies texts and suggested 
children's literature were either listed on the ECA Word List or were 
synonyms of the terms on t list (Appendix B). 

- INSERT TABLE THREE ABOUT HERE - 

Of the terms used in selected sixth grade social studies textbooks 
to describe Oriental cultures, eighteen tenns had two or more occurrences 
within the analysis. Of those eighteen terms, thirteen were rated favorable 
in relation to Oriental cultures. The percentage and rating of the terms 
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indicated, in general, a favorable attitude towards Oriental cultures is 
presented in the social studies textbooks analyzed. 

— INSERT TABLE FOUR ABOUT HERE — 

Seventeen terms were used five or more times in the analysis of the 
twenty-six children's literature selections. Of the seventeen terms, 
eleven were rated favorable in relation to Oriental cultures with five 
being rated as unfavorable. One term was rated as a neutral or ambivalent 
term. The percentage and ratir-- of these terms, in general, indicate a 
samewhat neutral reflection of 0. iental cultures in the children's 
literature suggested for supplemental use by the social studies text 
publishers. 

FINDINGS 

Question 1. Do the selected social studies textbooks provide an 

unbiased representation of Oriental cultures? 

Of the ninety-four evaluative terms listed on the ECA Word List 
indicating a favorable, unfavorable, or ambivalent attitude in texts, 
fifty-five terms (approximately 60 percent) were rated favorable with 
thirty-four (approximately 36 percent) being rated unfavorable. Five 
terms (approximately 4 percent) were rated as being rputral. The 
selected sixth grade social studies textbooks do not provide a negative 
stereotypical representation of Oriental cultures, but tend to offer a 
favorable representation of Oriental cultures as indicated by the 
percentage of favorable ratings determined by ECA. 
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Question 2. Does the children's literature suggested for use by 
publishers of social studies textbooks provide a favorable 
representation of Oriental cultures? 

The children's literature suggested for use by the social studies 
textbook publishers generally provide a favorable representation of 
Oriental cultures as aetermined by ECA. Of the seventeen terms used 
most frequently in the children's literature analyzed relating to 
Oriental cultures, eleven terms (approximately 70 percent) were rated 
favorably, with five terms (approximately 30 percent) being rated 
unfavorably and one term (less than 10 percent) being rated as a neutral 
term. 

CONCLUSIONS AND RECOMMENDATIONS 

The findings of the current study indicate that the social studies 
textbooks under study were, generally, favorable in representation of 
Oriental cultures. Tenns rated in the study were, for the most part, 
favorable and generic in the sense they could be used to describe any 
given culture. 

The children's literature suggested for use by the social studies 
textbook publishers provide, overall, a favorable representation of 
Oriental cultures. The ratings of the tenns as defined by ECA, as well 
as the frequency of terms used, indicated accuracy was a focus of the 
literature. 

The current study has value concerning the usefulness of matenals 
used for instruction in elementary social studies classrooms. The matenals 
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which were analyzed, social studies textbooks and suggested children's 
literature, were generally favorable in their treatment of Oriental 
cultures. This information leads to the conclusion that the materials 
under study could be recommended for use as beinr generally favorable 
In the treatment of Oriental cultures. The study further indicates that 
similar studies of other materials could prove beneficial in the 
accumulation of data needed in order to make broader conclusions. 

Based on the findings of the current study, the following 
reconr^ndations are made: 

1- Publishers of social studies textbooks should continue their 
inclusion of supplemental bibliographies for student and teacher 
use, hut make every effort to assure that cultural representations 
are nonstereotyped. 

2. More research is needed to discover whether or not the majority 
of supplemental materials are correlated with the textbooks used in 
social studies classrooms. 

3. More research is needed to discover how cultural information 
affects t'e attitudes of children, concentrating on long term effects. 

4. More research is needed regarding the by teachers of the 
supplemental materials. 
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Table 1 



Rating of Terms Oescribing Oriental Cultures 
in Selected Social Stu<. es Texts 



Favorable Unfavorable fieutral 
Text 1* Terras J. Terms ^0 Terms EC A 



The World 10 4 1 72 

rhe £arth 6 6 1 50 

The World and 12 8 2 60 
I ts People" 

Our World 9 2 0 82 

Our World: Lands 18 14 1 56 
and Cultures 



1^ 
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Table 2 

Rating of Terms Describing Oriental Cjitures 
in Supplemental Children's Literature 



favorable Unfavorable \eutra1 

Sook J+ Terms Terms "O Terns ECA 

Book A 7 3 ^ in 

Book 8 6 4 \ In 

BookC 10 7 0 M 

BookD 7 4 0 II 

Book E 8 4 0 fi7 

Book F 5 7 of? 

Book G 7 6 1 J! 

Book H 8 2 0 In 

Book J 5 6 0 Ifi 



Book K 3 7 0 S 

BookL 7 5 ? 30 

Book M 7 3 i ;2 

Book N 10 3 0 77 

Book 0 9 2 2 II 

Book Q 5 5 1 CO 

Book R 7 3 9 ^2 

Books 7 6 I II 

Book T 13 10 2 I7 

Book U 9 1 1 90 

BookV 75 0 ?4 

Book W 7 3 9 ii 

Book X 13 1 5 II 

Book Y 10 9 ? « 

Book! e 3 0 66 
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Table 3 



Terms Most Frtquentiy Used In Selected Social Studies 
Texts To Describe Oriental Cultures 
(2 or more occurrences)* 



Term 



Number of Tinies Used 



ca re f^; ] 
duty 

educated 

friendly 

fighter 

free 

fear 

good 

happy 

honorable 

important 

independent 

loyal 

poor/ poverty 

problem: 

respect 

supericr 

skill?i 



+ 
+ 

+ 
+ 
+ 



♦ indicates terms used favorably. 

• indicates terms used unfavorably. 
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Table 4 

Terms Most Frequently Used In Selected Children's 
Literature To Describe Oriental Cultures 
(5 or more occurrences)* 



Number of Times L-sed 

Tern 5 6 7 8 9 10 i: 12 



beauti ful 

crowded 

fear 

fight 

free 

friend 

good 

happy 

honor 

independent 

important 

Toyal 

poor/poverty 
pride 
prirai ti ve 
sifnple 
skilled 



+ 



+ indicates terms used favorably. 
- indicates terms used unfavorably. 
C indicates terms used neutrally. 
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ECA viori Lis' 



Sc:T:e exanples 

Term 

calm 

capable 

Ccref 

charitable 

chari?! ng 

cheap 

chivalrous 

civilized 

clean 

clever 

cold 

colorful 

coiriRon 

complex 

conscientious 

conspirator 

corrupt 

courageous 

coward 

crafty 

criminal 

cruel 

cultured 

. daring 
dauntless 
dear 

dedicated 

delicate 

dellghtfjl 

dependent 

deserter 

detenri ned 

devoted 

devout 

dictator 

di rty 

disgruntled 



bating of 
Terx 



+ 
0 
0 
+ 



0 



erm 



Sating of 
Terra 



disloyal 

distinguished 

crunk 

eager 

elegant 

eloquent 

enduring 

energetic 

enthusiastic 

experienced 

expert 

extremist 

failure 

fair 

faithful 

false 

famous 

fat 

fearful 

fearless 

feeble 

ferocious 

fierce 

f i rey 

fine 

foolish 

foreign 

free 

friendly 
furious 

genius 
gentle 
gentleman 
gi f ted 



+ 
+ 



0 



0 



•Terms taken from the Evaluation Coefficient System developed 
by David Pratt (1972). 
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